Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/8053/
• CommitID: b41a5c6

@dblock seems like changes in Version.java are missed?

@reta We're doing funky things here on main. See if this is OK? Are those comments useful?

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/8068/
• CommitID: 52f7715
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

@reta We're doing funky things here on main. See if this is OK? Are those comments useful?

@dblock unfortunately they still are:

/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:86: error: cannot find symbol

    public static final Version V_2_4_1 = new Version(2040199, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
> Task :server:compileJava
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:89: error: cannot find symbol
    public static final Version V_2_4_2 = new Version(2040299, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:90: error: cannot find symbol
    public static final Version V_2_5_0 = new Version(2050099, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version

The issue here is that we (OpenSearch) build our own Apache Lucene snapshots and publish them, I sadly don't know the details how often we do that, but we have not done that in a while, and hence we have pretty old 9.5.0 snapshots without 9.4.2 reference :(

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.indices.stats.IndexStatsIT.testFilterCacheStats
      1 org.opensearch.cluster.allocation.AwarenessAllocationIT.testThreeZoneOneReplicaWithForceZoneValueAndLoadAwareness

• URL: https://build.ci.opensearch.org/job/gradle-check/8066/
• CommitID: b621228
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.indices.stats.IndexStatsIT.testFilterCacheStats
      1 org.opensearch.cluster.allocation.AwarenessAllocationIT.testThreeZoneOneReplicaWithForceZoneValueAndLoadAwareness

• URL: https://build.ci.opensearch.org/job/gradle-check/8066/
• CommitID: b621228
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

#2501

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/8074/
• CommitID: 52f7715
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

@reta We're doing funky things here on main. See if this is OK? Are those comments useful?

@dblock unfortunately they still are:

/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:86: error: cannot find symbol

    public static final Version V_2_4_1 = new Version(2040199, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
> Task :server:compileJava
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:89: error: cannot find symbol
    public static final Version V_2_4_2 = new Version(2040299, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:90: error: cannot find symbol
    public static final Version V_2_5_0 = new Version(2050099, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version

The issue here is that we (OpenSearch) build our own Apache Lucene snapshots and publish them, I sadly don't know the details how often we do that, but we have not done that in a while, and hence we have pretty old 9.5.0 snapshots without 9.4.2 reference :(

@reta: Thanks for sharing this. I see

@reta We're doing funky things here on main. See if this is OK? Are those comments useful?

@dblock unfortunately they still are:

/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:86: error: cannot find symbol

    public static final Version V_2_4_1 = new Version(2040199, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
> Task :server:compileJava
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:89: error: cannot find symbol
    public static final Version V_2_4_2 = new Version(2040299, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version
/home/runner/work/OpenSearch/OpenSearch/server/src/main/java/org/opensearch/Version.java:90: error: cannot find symbol
    public static final Version V_2_5_0 = new Version(2050099, org.apache.lucene.util.Version.LUCENE_9_4_2);
                                                                                             ^
  symbol:   variable LUCENE_9_4_2
  location: class Version

The issue here is that we (OpenSearch) build our own Apache Lucene snapshots and publish them, I sadly don't know the details how often we do that, but we have not done that in a while, and hence we have pretty old 9.5.0 snapshots without 9.4.2 reference :(

There seems to be lucene snapshot workflow which generates the snapshots but needs aws account creds. @dblock @nknize : Any idea how do we trigger this job ?

There seems to be lucene snapshot workflow which generates the snapshots but needs aws account creds.

Exactly :(

We shouldn't bump Lucene versions without triggering a snapshot build or updating the versions file with the next release (and updating shas). This should happen in a dedicated PR. I went ahead and triggered the next snapshot build.

https://github.com/opensearch-project/OpenSearch/actions/runs/3690669028

We shouldn't bump Lucene versions without triggering a snapshot build or updating the versions file with the next release (and updating shas). This should happen in a dedicated PR. I went ahead and triggered the next snapshot build.

https://github.com/opensearch-project/OpenSearch/actions/runs/3690669028

The publish-snapshots step is failing @nknize

publish-snapshots
OpenIDConnect provider's HTTPS certificate doesn't match configured thumbprint

/cc @mch2 can you take a look when you get a chance?

/cc @mch2 can you take a look when you get a chance?

Seems like flaky behavior with OIDC, I've added the most current GH thumbprint manually and kicked off a run of lucene branch_9_4 - created version 9.4.3-snapshot-bb7785b and branch_9x - created version 9.5.0-snapshot-d5cef1c . For more info on the thumbprints - aws-actions/configure-aws-credentials#395.

There seems to be lucene snapshot workflow which generates the snapshots but needs aws account creds.

Exactly :(

Yep my fault sorry about this, I never pushed the cdk code used. I reused this cdk project from data-prepper to use an s3 bucket as our maven repo. Will move all this cdk config to a folder in core.

Closing this in favour of #5570